DOCUMENT RESUME 



ED 058 647 



88 



EA 003 967 



AUTHOR 

TITLE 



INSTITUTION 
PUB DATE 
NOTE 

AVAILABLE FROM 



Denham, Carolyn H- . 

Elerosntary and Secondairy Education Act Title III in 
Massachusetts/ an Evaluation. A Study of Variables 
Related to Success, Continuation, and Dissemination 
of Title III Projects. 

Massachusetts State Dept, of Education, Boston. 

71 

21p. . 

New York State ERIC Service, Room 468 EBA, State 
Education Department, Albany, New York 12224. 
(Microfiche copies available free to educators) 



EDRS PRICE MF-$0«65 HC-S3.29 . , *.• 

DESCRIPTORS Adoption (Ideas) ; Educational Change; Educational 

Problems; Educational Programs; *Educational 

♦Federal Aid; ♦Information Dissemination, 
Problem Solving; ♦Program Evaluation; Program 
Improvement; Questionnaires; ♦State Departments of 
Education; State Programs; Superintendents 
IDENTIFIERS Elementary Secondary Education Act Title III; ESEA 

Title III; Massachusetts 



ABSTRACT . 

This publication represents a major attempt by the 

Massachusetts Department of Education to involve itself in what 
educators call the "change process” — using research to help develop 
solutions to educational problems, and disseminating results to 
facilitate adoption of those solutions by many schools. Title III 
provides federal funds in periodic grants to local schools to 
stimulate the development of creative solutions to educational 
problems. Each Title III project in Massachusetts rs responsible for 
evaluating the success of its stated objectives and for disseminating 
that information. This study was undertaken to provide an overview of 
the change process and account for its successes and failures. It 
affords administrators a statewide perspective on their own rate of 
change, and suggests new priorities for the Department's staff as 
well. (Author) 



Miassachufletts B<Mrd pf"M Mr,8vR.ac.CecUia Kipp, , 

Sullivan, Vicc-Cliair man 

Walter N.-B 

■ '•MrSv'Rainpria:^ 

WilliaimP/iDem 

; ‘ J.' RicKard k' ■ 

- 'r ':: 1 ,;v r-;:;vAlWn^^ ' 

V V:i "' v'v'v'' ■; •' 



‘.t t. V 



‘ GbinmiM of Eidlicatidh . , jNeil V / SuUiyah ■ 



y !- ■' r-S • .. 'f- 'r 1 , ,;^^.■t;/_.-..-: i .• : ..' . ■ J/'* f 









■ ■ ■ ■' A ■ J: ' ^ •L.i' / iv;/ ;■ 

^ ;>;r> •'■:'• V'-^ -"iv ':'K AsidpiAtt^^ M^Riirti?^|iyiak', H:Vv:' ' f ' ' ^ ' ■' ' 



■ ..'"t r I ‘ Jt,,v- >,Vu'..-v 1 '.-i-' » ... - •■ <V.. i-.v ’1',.^/ • •- (' » *Vl :..••• V -.u -r- ■;■•-■-•, • '-J ^ ;■'... i- 








Publication of this document approved by Alfred C. Holland, State Purchasing Agent. 

10M-10-T1-050514 

Estimated cost per copy $ .23 






sO 

CO 



o 

\jj 



AJ.S, DEPARTMENT OF HEALTH, 

E DUCATION & WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT. POINTS OF VIEW OR OPIN- 
IONS STATED DO NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY. 




Elementtrv and Secondary Education Act 

Title III in Massachusetts/ 

an Evaluation 



A Study of Variables Related to Success, Continuation, 
and Dissemination of Title 1 1 1 Projects 





ERIC 

MMiffilffTlTLillJ 



i 

by Carolyn H. Denham 



Commonwealth of Massachusetts 
Department of Education 

/ 91 / 

O 






NOTE 



"Supposing is good^ hut finding out 
is better . " 



Mark Twain 

This publication represents a major attempt by the Massachusetts 
Department of Education to involve itself in what educators call 
the "change process" - using research to help develop solutions 
to educational problems, and disseminatinc^ results to facilitate 
adoption of those solutions by many schools. 

As part of the Elementary and Secondary Education Act of 1965 
(amended 1967), Title III provides federal funds in periodic 
grants to local schools to stimulate the development of creative 
solutions to educational problems. Federal guidelines spell 
out the objective: "To translate the latest educational knowledge 
about teaching and learning into widespread educational programs 
and to create an awareness of new programs and services of high 
quality that can be incorporated in school programs." 

Each Title III project in Massachusetts is responsible for eval- 
uating the success of its stated objectives, and disseminating 
that information. This is a necessary step in gaining enough 
local support to continue operation at the end of the federal 
funding period (usually three years); It is also essential for 
Incorporating these newly developed programs and services Into 
other schools In the Commonwealth. 

Through Its Title III staff, the state should provide an overview 
of this change process, and account for Its successes and failures. 
The following study was undertaken for just this purpose. It 
affords administrators a statewide perspective on their own rate 
of change, and suggests new priorities for the Department's staff 
as well. 



Donald Torres , Coordinator, 
E.S.E.Ai Title III 
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I. Introduction 




The Elementary and Secondary Education Act of 1965 
Included a $100 million authorization for supplementary 
services and centers under Title III. An examination 
of the Act Itself and subsequent Interpretations by the 
U.S. Office of Education show how the Title became 
associated with demonstration centers for educational 
Innovation, seed money for diffusion of Innovations, and 
risk money for experimentation In school reforms.^ The 
present study Is an attempt to assess how well the Title 
III program In Massachusetts has conformed to the Idea 
of Title III as a force for educational Innovation: the 
extent to which projects have met the expectations of 
superintendents, the extent to which they have been con- 
tinued In the school district beyond the termination of 
federal funding, and the extent to which the educational 
practices they demonstrate have been adopted by other 
school districts. 

A survey of all superintendents of schools In Massa- 
chusetts was conducted to determine the extent to which 
Title III Innovations have spread outside the school dis- 
tricts receiving the grants, the attitudes of superinten- 
dents toward the spread of Innovations, and the superin- 
tendents* sources of Information about Innovations. 
Additional questions were asked of the superintendents 
of districts participating In Title III grants to deter- 
mine the extent of dissemination, continuation, and 
success of the projects. Recommendations are mads con- 
cerning funding, evaluation of project proposals, and 
dissemination. 

A similar study was conducted by Hearn, ^ who surveyed 
superintendents throughout the United States. However, the 



^’Hearn, Norman E. Innovative Educational Program s; 

A St udy of the Influence~~oT~Selected Variables Upon 
Continuation Poiro'wl ng the termination of Three -Year esEm 
T itle ill Grants. Sponsored by the Department of l^»rai 
Education of the National Education Association. Washing- 
ton, D. C.; September 30, 1969> PP. 1-6. 
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present study provides information not found in the 
former study. Whereas the present study surveyed all 
superintendents in Massachusetts, the Hearn Study 
omitted those in districts not receiving Title III 
funds and those in districts participating in a regional 
project but not serving as the administrator of the 
grant funds for the regional group. The present study 
affords the opportunity for a close look at the workings 
of Title III within a single state, gives more recent 
statistics than does the Hearn study, and provides infor- 
mation on how well the projects met superintendents' ex- 
pectations . 



n. Hypothesis 

1. Districts receiving Title III grants or parti- 
cipating in a Title III regional project are more likely 
to adopt Title III innovations from outside their dis- 
trict than are non-Title III districts. 

2. Regional and single district projects differ in 
how well they meet the expectations of superintendents. 

3. Single district projects are more often continued 
after the termination of federal funds than are regional 
projects . 

4. The local educational agency or LEA, the school 
district entrusted with the grant money for districts in 
a regional project, differs from the other districts par- 
ticipating in the project in the extent to which the pro- 
ject meets the superintendents' expectations. 

5. The LEA differs from the other districts parti- 
cipating in the project in the frequency of continuation 
after termination of federal funds. 

6. For single district projects the extent to which 
superintendents' expectations are met is related to the 
size of the grant. 

7. For regional projects the extent to which super- 
intendents' expectations are met is related to the size of 
the grant. 

8. For single district projects the frequency of 
continuation after termination of federal funds is related 
to the size of the grant. 

9. For regional projects the frequency of continuation 
after termination of federal funds is related to the size 

of the grant. 
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III. Data G)Uection 

A one-page questionnaire was mailed to all 270 super- 
intendents in Massachusetts on April 30^ 1971* An addi- 
tional two pages of questions was sent to those 143, super- 
intendents whose districts had received or were receiving 
Title III funds. By May 28 , 52^ of the superintendents 
had responded. A second mailing on May 28 elicited enough 
responses to bring the response rate up to 222 or 83% (113 
or 86^ for superintendents with Title III projects, and 
109 or 79% for all other superintendents). Tabulations of 
the responses are given in the Appendix. The questionnaire 
was designed to obtain information on the status of Title 
III projects, such as the percent of projects being con- 
tinued, as well as data for testing the hypotheses. 



IV. Summary of Findings 

The results of the statistical tests of the hypothe- 
ses are as follows: 

1. Title III districts were significantly more 
likely to pick up Title III innovations outside their 
district than were non-Title III districts. 

2. No significant difference was found between 
regional and single district projects in how well they 
met expectations of superintendents. 

3. Single district projects were significantly 
more likely to be continued than were regional projects. 

4. 5. No significant difference was found between 
the LEA for a regional project and the other districts 
participating in the regional in extent to which expecta- 
tions were met or the likelihood of continuation. 

j 6, 7. No significant difference was found, for 

! either single district projects or reglonals, between 

i the mean size of the grant for those projects meeting 

I objectives and the mean grant size for those not meeting 

objectives . 

8, 9. No significant difference was found, for 
either single district projects or reglonals, between 
[ the mean size of the grant for those projects which were 

I continued and the mean grant size fbr those which were 

not continued. 

The results of the tabulations of responses are as 
I follows: 

i: 

!f 
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1. Almost all of the superintendents (96^) had 
heard of one or more ESEA Title III projects outside 

his district and almost all of these (90^) were familiar 
with one or more project. 

2. Among Title III superintendents, those superin- 
tendents whose districts had received a Title III grant or 
participated In a Title III regional project, 53^ Indi- 
cated that their school district or an educator In their 
district had changed or modified some educational procedure 
In response to Ideas or Information gained from an ESEA 
Title III project outside the district. Among other 
superintendents, 2d^ Indicated such changes. 

3. The project most often mentioned as Influencing 
other school districts was Project SPOKEj It was mentioned 
by 20 other districts. Tl’.'e Amherst Model Kindergarten 
project was mentioned 6 times; Project COD was mentioned 

4 times . Twenty-six other projects were mentioned one or 
two times each. Project SPOKE, located In Norton, Is a 
regional resource center for teachers providing In-service 
programs. Instructional materials and facilities for teach- 
ers to produce their own Instructional materials. The 
Amherst Model K^.ndergarten Is an experimental "child- 
centered" kindergarten. Project COD, located In New Bed- 
ford, Is a regional service center for curriculum develop- 
ment with emphasis on training teachers and administrators 
for leadership roles In curriculum Improvement. 

4. Superintendents whose districts had adopted 
parts of other Title III projects were asked to state 
how they found out about the projects. Superintendents 
whose districts had their own Title Ill's most often 
found out from their own Title III people. Next In Impor- 
tance, in descending order were (a) staff members of Title 
III projects outside their district, (b) Title III meet- 
ings, workshops, and fairs, (c) "Kaleidoscope," and (d) 
professional conferences. Other superintendents mentioned 
a variety of sources, with "Kaleidoscope" being the only 
source mentioned more than once. (It was mentioned twice.) 
"Kaleidoscope" Is a serialized booklet describing educational 
Innovations in Massachusetts published by the Bureau of 
Curriculum Innovation of the Massachusetts Department of 
Education . 



5. When asked which sources they found most helpful 
In gaining Information on educational Innovations, Title 
III superintendents listed. In descending order of Impor- 
tance : 



(a) Publications from the Bureau of Curriculum 
Innovation, the bureau in the Massachusetts 
Department of Education responsible for 
admlnlst'erlng Title III funds. 
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(b) Professional conventions. 

(c) Visits to innovative projects. 

(d) Other school administrators. 

(e) Mailings of pamphlets, newsletters, etc. 

(f) Professional Journals 

Other superintendents listed the following sources: 

(a) Other school administrators 

i (b) Publications from the Bureau of Curriculum 
Innovations 

(c) Professional conventions 

(d) Mailings of pamphlets, newsletters, etc. 

(e) Professional Journals 

(f) Visits to innovative projects 

6. The Journals mentioned as most helpful in gaining 
information on educational innovations were, in dr.scendlng 
order: 

(a) Phi Delta Kappan 

(b) Educational Leadership 

(c) Nation's Schools 

(d) School Management 

In all, 29 Journals were mentioned. 

7. Superintendents were asked their opinions on 
three statements about educational innovations: 

(a) Sixty-four percent disagreed or disagreed 
strongly to the following statement: In 

Massachusetts we are proceeding too rapidly 
in introducing into the schools innovations 
which have not been thoroughly tested. 

Title III superintendents were slightly 
more inclined to disagree than were other 
superintendents . 

(b) Seventy-two percent agreed or agreed 

strongly to the following statement; It 
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Is difficult to obtain reliable information 
for assessing the merits of popular educa- 
tional innovations." Ncn-Tltle III super- 
intendents were slightly more Inclined to 

agree . 

(c) Eighty-five percent agreed or agreed strongly 
to the following statement: "My school 

district Is usually supportive of attempts 
to introduce innovation." Title III super- 
intendents were slightly more inclined to 
agree . 

8 . Seventy-one percent of the Title III superinten- 
dents reported that their project had met or exceeded 
expectations. Twenty-eight percent of the projects ex- 
ceeded expectations; forty- three percent met expectations. 

In tabulations of responses of Title III superintendents, 
those superintendents of districts with more than one 
Title III project are counted more than once. 

9. Forty-eight percent of the Title III superinten- 
dents reported that the evaluation data were useful in 
making decisions about the project. Twenty-one percent 
were uncertain; for eighteen percent, the evaluation data 
were not yet available . Twelve percent did not think that 
the evaluation data had been useful. 

10. Fifty-four percent of the Title III superinten- 
dents said that Title III had definitely made their commun- 
ity more open to innovation. Thirty percent said that 
Title III made their community only somewhat more open to 
innovation. 

11 . Only nine Title III superintendents knew of other 
school districts which had adopted all or part of their 
ESEA Title III project. One superintendent stated that 
30 districts had adopted the Title III Innovation, of his 
district; the others knew of one. to 12 districts each. 

The means of dissemination listed by these districts were 
visits by teachers, newsletters, conferences sponsored by 
the project, and "direct communication. ' 

12. Sixty-nine percent of the Title III superinten- 

dents reported that the. projects were being continued or 
were likely to be continued after the termination of 
federal funding ( 38 ^ on a smaller scale j 24^ on the same 
scale, and 85 ^, on a larger scale) T^^ percent 

were reported not to be continuing, but if this figure 

is adjusted for those for which there , was [no] necessity 
to continue" and those being continued by other than local 
funds, only twelve percent are not being continued. Eight 
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percent of the superintendents were the 

continuation of the projects. These 2^ Sf^Massa- 

fi(nires reDorted by Hearn, who found that oO^ of wassa 

chusetts projects would be continued and 20^ vould not 
be'fo^tlnSedi slncr data ^ the present study Includes 
all districts Involved in a regional project, the percentage 

of continuation figure Is weighted stuto^^ 

projects in the present study than in the Hearn study. 



13. The most frequently cited reasons for not con- 
tinuing are listed in descending order of frequency: 



tied 



(a) 

(b) 

(c) 

(d) 

(e) 

(f) 

(g) 

(h) 



Project too expensive for the district 
to continue 

District never really committed to the 
project from the beginning 

Project not successful in meeting its 
objectives 

Uncertainty of federal funds 

Inadequacy of public relations within 
the community 

Personnel problems 

Not enough time to demonstrate the value 
of the project 

Failure of the project staff to work 
closely with the school administrators 



V. Condusion and Recommendations 

1. Some information about Title 
to be circulating fairly well; 

are familiar With at least one Title III project outside 
thlir dl strict. But the rate of adoption pf 
as would be expected, is quite a bit lower. In his stu y, 
Hearn found that 475^ of superintendents of LEAs were 

"f similar programs started «!*««*'!« 4 net 

to their oroleot) on the average, they knew of zo.c nei» 
programs llcL ih the present study only 8^ ®fYhe. super- 
intendents reported knowledge leaL 

trlcts; the mean number of <ils^rlct8 was 7. ™ 

us to suspect that the rate of adoption 
innovations has been slower in Massachusetts than fcr 
the U.S. as a whole. 

2. Since so few superintendents knew of other dls- 
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tricts that had adopted the innovations, perhaps a better 
feedback system for dissemination should be required. A 
project could be required to find out which of its dissem- 
ination methods were leading to adoption of the innovation 
by other districts. 

3. A project may need more than three years for 
dissemination. This might be accomplished by giving dis- 
tricts continuing projects extra money for dissemination, 
or it might be accomplished by convincing districts 
continuing projects to keep up the dissemination activi- 
ties themselves . 

4. The rate of adoption of Title III innovations 
from outside the district was significantly lower for 
non-xltle III superintendents. This may reflect in part 
the type of districts to which Title III monies have 
gone, but it also may be a result of the forming of a 
community of Title III recipients who share ideas . Evi- 
dence for the existence of this community is the sources 
of information on innovation mentioned by Title III super- 
intendents, Title III staffs and Title III meetings were 
major sources of information. The existence of such a 
community is an additional benefit for districts with 
Title III funds. However, it may be perpetuating the 
problem of certain districts being more sophisticated in 
their ability to think of projects that have a good 
chance of being funded, to write proposals, and to carry 
out grants, whereas the Title III office has a responsi- 
bility not to favor the existing "Title III Community" 

in awarding grants. 

The "community" can be a valuable aid in dissemina- 
tion, however, particularly if it makes an effort to reach 
non-Tltle III districts. Since non-Tltle III administra- 
tors rely heavily on other school administrators for ideas 
on innovation. Title III staffs should keep school admin- 
istrators in theM-r own districts Informed so that they 
can disseminate information to other administrators. Per- 
haps the administrators and their Title III stafft could 
also make presentations at professional conventions and 
contribute to professional journals, particularly those 
Journals mentioned by respondents. Visits to innovative 
projects have been less Important as a source of informa- 
tion for non-Tltle III superintendents than for Title III 
superintendents; perhaps non-Tltle III superintendents are 
not being invited to visit projects often enough. 

5. In dissemination, care should be taken to give 
complete and reliable information. Superintendents, 
particularly non-Tltle III superintendents, complain 
about the difficulty of obtaining reliable information. 



and quite a few are concerned about the rate of adoption 
of innovations which have not been thoroughly tested. 
Informal explanations, as well as formal presentations 
and articles, would be more effective if they Included a 
frani: discussion of pros and cons and did not try to im- 
press with modish terminology. Both Massachusetts Depart- 
ment of Education personnel and project personnel should 
be willing and able to answer questions on the effective- 
ness of the project and to discuss whether or not they 
would recommend the program for another district. This 
would require that they be familiar with evaluation results 
and that evaluators present readable reports that can be 
used in explaining the pros and cons of the project to 
outsiders. Evaluation services can be subcontracted by 
both the LEA and the SEA (State Educational Agency), but 
the permanent staffs of these agencies should understand 
and be familiar with the results of these evaluations. 

6. The Bureau of Curriculum Innovation can be 
pleased with the readership of its publications. Bureau 
publications are listed as the most Important source of 
information on innovations for Title III superintendents 
and are listed second for other superintendents. "Kaleido- 
scope" was an Important source of information on Title 

III projects for both groups of administrators. However, 
dissemination should Include personal contacts as well as 
the printed word; this is emphasized by the lists of sources 
of information considered most useful by superintendents. 
Perhaps the Bureau of Curriculum Innovation should choose 
a few of the most successful projects and begin to dissem- 
inate them by visits to individual school districts or 
groups of educators. The Bureau of Curriculum Innovation 
could also disseminate information in a useful form to 
other members of the Massachusetts Department of Education 
so that they in turn could talk to educators in the state. 

7. The success of project SPOKE in dissemination 
should be examined. Perhaps its methods of dissemination 
were particularly effective; perhaps its product was par- 
ticularly easy for educators in other districts to adopt. 
When choosing projects for funding, it might be wise to 
consider which projects would be the easiest to disseminate 
and would have the greatest Impact across the state. 

8. Not only are non-Tltle III districts sometimes 
left- out of the dissemination process, but a project's 
own LEA may be neglected. Reasons for projects not con- 
tinuing Include "inadequacy of public relations within 
the community" and "failure of the project staff to work 
closely with school administrators.’’ Plans for community 
and administration involvement should be Included in the 
proposal . 



9. In general, most of the Title III projects met 
or exceeded the expectations of the superintendents, made 
the participating communities more open to Innovation, 
and are being or will be continued. This is very encour- 
aging Information. 

10. The fact that almost half of the projects found 
evaluation data valuable Is encouraging, but there is room 
for Improvement. Projects should be helped to gather more 
useful evaluation data. 

11. Reasons cited for projects not being continued 
should be reviewed. The most frequent complaint was that 
the project was too expensive for the district to continue, 
but Hearn found that the mean size of budgets of continued 
projects was twice the size of that for discontinued pro- 
jects. These seemingly conflicting statements plus the 
fact that no significant differences were found In the 
present study between the mean size of the budget of con- 
tinued and discontinued projects suggest a complex rela- 
tionship between budget size and continuation. The number 
of pupils served by the grant, the type of project, and 
the wealth of the community are probably all related to 
the problem. Proposed budgets should be examined closely 
for all of these factors. 

12. The present study found that regional projects 
were less likely to be continued than were single district 
projects. (Hearn, however, found no significant differ- 
ence.) The finding of the present study suggests that, at 
least In Massachusetts, many of the school districts need 
some supportive structure ar.lncent Ives other than three 
years of Title III money If they are to work cooperatively 
for more than three years. Until such Incentives are 
found, granting money to regional projects will be more 
risky than granting money to single districts. 

13 . An encouraging fact about regional projects, 
however. Is that money . granted to regional projects prob- 
ably does benefit more districts than Just the LEA. No 
significant differences were found In the extent to which 
LEA»s and other participating districts met expectations 
and continued the project. Also, there was no significant 
difference between reglonals and single district projects 
In their effectiveness In meeting expectations. 

14. In summary. Title III projects In Massachusetts 
did well In meeting the expectations of superintendents 
and Improving openness to . Innovation within the _ LEA or . 
participating district. The single district projects did 
particularly well In continuing the programs after termlna 
tlon of federal funds. Title III projects did less well 
In spreading Innovations throughout the state. Suggested 



priorities for improvement are the rate of adoption of 
innovations by non-Tltle III districts and the rate of 
continuation of regional Title III projects. 
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APPENDIX 



A Data Analysis 



One test of statistical significance was performed for 
each of the hypotheses; 

1 . The first test was a comparison of responses by 

Title III superintendents and non-Tltle III superintendents 
to the following question: ”Has your school district (or 

any educator in your district) changed or modified any 
educational procedures in response to ideas or information 
gained from ESEA Title III projects outside your district? 

A chi-square of 20.19 with 2 degrees of freedom was signi- 
ficant beyond the .01 level. Tnus there was a significant 
difference in the responses of the two groups, with more 
Title III superintendents replying "yes^ and more non-Tltle 
III superintendents replying "no. ' 

2. The second test was a chi-square comparing Title 
III superintendents with regional projects to those with 
single district projects in their responses to the follow- 
ing question; "How well has the project come up to your 
expectations?" Those answering "exceeded expectations 

or "met expectations" were grouped together; those answer- 
ing "fell somewhat short of expectations" or "fell far 
short of expectations" were grouped together. The chi- 
square was not significant (%2 » 1.44, df = l). 

3. The third test was a chi-square comparing regional 
and single district projects on the following questions; 

"Is the project being continued (or likely to be continued) 
after the termination of federal funding?^' Responses were 
grouped into two categories; (1) "no" and (2) 'yes,^^on 

a smaller scale or with only some of tlie components, and 
"yes, on the same scale, " and "yes, on a larger scale. 
"Uncertain" responses were omitted. Also omitted were 
superintendents answering "no" but who Indicated that the 
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project was being continued by other than local funds or 
that there was no necessity to continue since the objec- 
tives were completed within the time span provided by 
federal funds. The chi-square was slnglflcant beyond 
the .05 level = 5.32, df = l) with single districts 

being more likely to continue projects. In fact, all of 
the 22 single district projects were being continued, 
whereas 37 of the 50 regional projects ( 74 ^) were being 
continued. 

4, 5. The fourth and fifth tests were comparisons 
of responses of superintendents whose districts were 
LEAS for regional projects and those whose districts were 
participants In regional projects. Chi-square tests un- 
covered no significant differences between LEA districts 
and participant districts on the following two questions: 
"How well has the project come up to your expectations? 
and "Is the project being continued (or likely to be con- 
tinued) after the termination of federal funding? 

6, 7. The sixth and seventh significance tests 
were comparisons of the size of grants for projects 
which met expectations to the size of grants for those 
which did not meet expectations. The average size of 
the grant over the operational years of a project was 
used to represent the size of the grant. The sixth test 
was a t test comparing mean grant sizes for single district 
projects. The mean for projects which met expectations was 
$76,720; the mean for those that did not meet expectations 
was $ 85 , 330 . However, the value of t was not significant. 

The seventh test was an analysis of variance among 
the means for regional projects. Superintendents within 
the same regional project were grouped together for the 
analysis; they could not be considered separate cases since 
their budgets were, of course. Identical. A regional pro- 
ject was classified as meeting expectations If 65 ^ or over 
of the superintendents responding Indicated that the pro- 
ject met expectations; If 655^ or over of the superinten- 
dents Indicated that the project did not meet expectations. 
It was put Into a second group; otherwise. It was placed 
Into a third group. Regional projects represented by 
only one responding district were not classified. The 
analysis of variance did not uncover significant differences 
between mean grant sizes for regional projects with varying 
degrees of success. 

8, 9 . The mean: grant size for projects which were 
continued was compared to the mean grant size of projects 
which were not continued. No significance test was 
necessary to determine that there was no significant 
relationship between grant size for single district 
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projects and continuation of the projects: all single 
district projects were continued (except those omitted 
from the analysis for reasons cited under the discussion 
of the third statistical test). The final test was an 
analysis of variance of the mean grant size of regional 
projects; projects were classified according to a scheme 
analogous to that used for the seventh statistical test. 

No significant difference was found among the means for the 
three categories of project continuation. 



B Questionnaire for Superintendents 
who have never received Title in funds 



Questionnaire for Superintendents 



Name of school district 



Enclosed Is a list of projects In Massachusetts sponsored 
under Title III of the Elementary and Secondary Education Act 
of 1965. You may refer to this list. If necessary. In answering 
the following questions: 

1. Have you heard of any ESEA Title III projects outside your 

district? 104 - yes; 1 - uncertain; 5 - no. 

2. Are you familiar with the program of one or more ESEA Title 
III project outside your district? 

90 - yes; 5 - uncertain; 14 - no. 

3. Has your school district (or any educator in your district) 

changed or modified any educational procedures In response 
to Ideas or information gained from ESEA Title III projects 
outside your district? 29 - yes; 34- uncertain; 42 - no. 

If yes, please specify. If possible. Indicate how you or 
others learned about the project. 



4. VIhat sources do you find most helpful In gaining Information 
on educational Innovations? 

54 - Professional Journals (If so, which ones?) 
oO - Mailings of pamphlets, newsletters, etc. 

30 - Books 
7 - Television 



o 



5 - Radio 

29 - Newspapers 

30 - Magazines 

74 - Professional conventions 

11 - Education courses at colleges 

55 - Visits to Innovative projects 

74 - Publications from the Bureau of Curriculum 

Innovation at the Massachusetts Department of 
Education (Kaleidoscope, Keynotes, etc.) 

81 - Other school administrators 

31 - Teachers 

10 - Students 
9 - Parents 

34 - Massachusetts Department of Education personnel 
4 - Other (Please specify) 



5. Indicate your reaction to each of the statements below 
using the following abbreviations; 

DS - Disagree strongly A - Agree 
D - Disagree AS - Agree strongly 

U - Uncertain 

(a) In Massachusetts we are proceeding too rapidly In 
Introducing Into the schools Innovations which have 
not been thoroughly tested. 

25 - DS; 40 - D; 23 - U; 12 - A; 7 - AS. 

(b) It Is difficult to obtain reliable Information for 
assessing the merits of popular educational Inno- 
vations . 

2 - DS; 18 - D; 8 - U; 59 - A; 21 - AS. ' ^ 

(c) My school district Is usually supportive of attempts 
to Introduce Innovations. 

0 r DS; 8 - D; 14 - U; 71 - A; l4 - AS. 



C Questionnaire for Superintendents 
who have received Title III funds 



Section I 

Name of school district ■ • ^ ■; '• ' -■' ; ‘ — — 

Enclosed Is a list of, projects In Massachusetts sponsored 
under Title III of the Elementary and Secondary Education Act 
of 1965« You may refer to this list. If necessary. In answering 
the following questions: 
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1. Have you heard of any ESEA Title III projects outside your 

district? 108 - yes; 1 - uncertain; 2 - no. 

2. Are you familiar with the program of one or more ESEA Title 
III project outside your district? 

101 - yes; 3 - uncertain; 7 - no. 

3. Has your school district (or any educator In your district) 

changed or modified any educational procedures In response 
to Ideas or information gained from ESEA Title III projects 
outside your district? 58 - yes; 3^ - uncertain; 17 - no. 

If yes, please specify. If possible. Indicate how you or 
others learned about the project. 



4, What sources do you find most helpful In gaining Information 
on educational Innovations? 

56 - Professional Journals (if so, which ones?) 

63 - Mailings of pamphlets, newsletters, etc. 

26 - Books 
7 - Television 

3 - Radio 

26 - Newspapers 
28 - Magazines 

78 - Professional conventions 

11 - Education courses at colleges 

75 - Visits to Innovative projects 

85 - Publications from the Bureau of Curriculum 

Innovation at the Massachusetts Department of 
Education (Kaleidoscope, Keynotes, etc.) 

73 - Other school administrators 
35 - Teachers 
6 - Students 

4 - Parents 

30 Massachusetts Department of Education personnel 
3 Other (please specify) 



5. Indicate your reaction to each of the statements below 
using the following abbreviations: 

DS - Disagree strongly A - Agree 

D - Disagree AS - Agree strongly 

U - Uncertain 

(a) In Massachusetts we are proceeding too rapidly In 
Introducing Into the schools Innovations which have 
not been thoroughly tested. 

23 - DS; 51 - D; 19 - U; 12 - A; 4 - AS. 





(b) It is difficult to obtain reliable Information for 
assessing the merits of popular educational Innova- 
tions . 

1 - DS; 23 - D; 6 - U; 49 - A; 19 - AS. 

(c) My school district Is usually supportive of attempts 
to Introduce Innovations . 

2 - DS; 8 - Dj 3 - U; 77 - A; 27 - AS. 

IF YOUR DISTRICT HAS RECEIVED ESEA TITLE III FUNDS, OR HAS 
PARTICIPATED IN A REGIONAL ESEA TITLE III PROJECT, GO ON TO 
SECTION II. OTHERWISE, STOP HERE. THANK YOU. 



Section II 

(To be completed If the district has received ESEA Title III funds) 

Name of project ■■ 

If your district has received ESEA Title III funds for more 
than one project, please report on each project. Number the 
projects and number each of your responses to the Items accord- 
ingly. 

1. Description of project: (check one or more of the following) 

58 - Curriculum development and/or Implementation 

13 - Reorganization of school structure 
38 - Teacher training 
32 - Services for handicapped 
27 “ Media centers and/or new technology 
3 - Guldance/counsellng 

6 - Community participation or social or racial Integration 
13 - Other (please specify) 

2. How well has the project come up to your expectations? 

27 - Exceeded expectations 

42 - Met expectations 

20 - Fell somewhat short of expectations 
8 - Fell far short of expectations 

0 - Uncertain 

3. Do you think that the evaluation of the project as required 
by ESEA Title III has been useful to you or others In making 
decisions about the project? 

46 - yes; 20 - uncertain; 12 - no; 18 - evaluation data 
not yet available. • 

4 . Do you think that ESEA Title III has made your community more 

open to Inhoyatlbh? ' \ ^ \ ^ ^ 

52 - Definitely^' yes r' [ 

29 - Perhaps a little / 

10 - Uncertain 
5 - Probably not 

1 - Definitely not 
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5. Are you aware of other school districts which have adopted 
all or part of your ESEA Title III project? If so, state the 
number of school districts and describe. If you can, the means 
of dissemination used to reach these districts. 

l4 - yes 

6. Is the project being continued (or likely to be continued) 
after the termination of federal funding? 

20 - no 

33 - yes, on a smaller scale or with only some of the 
components 

21 - yes, on the same scale 
7 - yes, on a larger scale 
7 - uncertain 

7. If the project or Important components of the project are 
not being continued (or are not likely to be continued) by 
local funds, indicate what you believe to be the reasons : 

4 - Project being continued by other than local funds 

6 - Inadequate public relations within the community 

8 - Project not successful in meeting its objectives 
15- Project too expensive for the district to continue 

9 - The district was never really committed to the project 

from the beginning 

1 - Project does not fit the goals or structure of the 

existing school program 

3 - No necessity to continue; objectives were completed 

within the time span provided by federal funds 

4 - The school districts Involved In the project failed 

to cooperate on a regional basis 

5 - Personnel problems 

2 - District unwilling to spend money on Innovations 

2 - Project too ambitious to be managed effectively 

6 - Not enough time to demonstrate the value of the project 

3 - Failure of the project staff to work closely with the 

school committee 

5 - Failure of the project staff to work closely with the 
school administrators 

0 > Lack of support or guidance from the Massachusetts 
Department of Education, ESEA Title III staff 

3 - Project not visible enough 

4 - Project served too few students 

7 - Uncertainty of federal funds hampered effectiveness 
4 - Other (please specify) 
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